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Abstract: 

When  a  human  and  an  intelligent  machine  work  together  as  a  team,  human  trust  can  influence 
performance.  Yet,  an  electrophysiological  signature  of  trust  has  not  been  isolated.  In  order  to  isolate 
such  a  signature,  we  recorded  fMRI  or  event-related  potentials  while  subjects  are  playing  two 
cognitive  games.  At  the  first  experiment,  human  subjects  played  a  theory-of-mind  bilateral  game  with 
two  types  of  computerized  agents:  with  or  without  humanlike  cues.  At  the  second  experiment,  human 
subjects  played  a  unilateral  game  in  which  the  human  subjects  played  the  role  of  the  Coach  (or 
supervisor)  while  a  computer  agent  played  as  the  Player.  Electrophysiological  activities  in  brain 
regions  belonging  to  the  theory-of-mind  network  correlated  with  perceived  capability,  especially  when 
a  machine  opponent  has  some  human-likeness.  In  particular,  our  research  shows  that  activity  in  the 
left  parietal  region  correlating  with  a  human  player’s  future  behavior  can  be  identified  as  the  neural 
signature  of  capability-based  trust.  These  results  reveal  that  brain  signals  underlying  trust  as 
influenced  by  perceived  capability  and  human-likeness  might  be  useful  for  performance  optimization 
of  human-machine  systems. 

Introduction: 

In  the  age  of  intelligent  machine  the  human  trust  in  machines  becomes  much  more  important  for 
efficient  operation  of  autonomous  systems  (AS)  and  decision  support  systems  (DSS)  where  human 
and  machine  work  as  a  team.  Several  studies  showed  that  the  human  trust,  distrust,  and  mistrust  in 
machines  significantly  affected  overall  system  performance.  Auto-pilot,  air  traffic  control,  and 
anti-aircraft  warfare  systems  may  be  examples  of  those  systems.  It  was  found  that  the  human  decision 
process  is  affected  by  the  trust  in  the  team-mates,  i.e.,  partners  or  counterparts.  For  the  efficient 
operation  as  a  team,  the  human  operator  should  neither  distrust  nor  mistrust  the  machine  team-mates. 
The  trust  is  dynamic,  i.e.,  previous  history  may  change  the  current  level  of  trust.  Also,  it  was  found 
that  the  human  trust  in  machine  team-mates  has  different  characteristics  to  that  in  human  team-mates. 
Therefore,  it  is  important  to  understand  the  impact  of  humanlike  cues  on  sequential  trust  development, 
maintenance,  and  degradation  in  machine  team-mates  for  the  better  design  of  AS  and  DSS. 

It  is  understood  that  trust  has  multidimensional  characters.  Barber  had  identified  3  axes  for  the  trust 
space,  i.e..  Persistence  (Reliability),  Technical  competence  (Ability),  and  Fiduciary  responsibility 
(Moral  and  social  obligation).  Also,  the  trust  dynamics  are  greatly  affected  by  humanlike  cues  such  as 
facial  expression,  speech,  and  personality. 

Although  many  researches  had  been  reported  on  trust  with  behavioral  data  on  the  3  axes,  only  a  few 
brain  imaging  studies  have  been  reported  on  trust.  Neural  correlates  of  ‘static’  trustworthiness  had 
been  studied  for  human  faces  and  online  web  without  feedback  process.  For  the  ‘dynamic’ 
development  of  trust  with  feedback  process,  sequential  bilateral  trust  games  between  human  and 
machine  counterpart  had  been  utilized  for  the  fiduciary  responsibility  (moral),  i.e.,  the  willingness  to 
cooperate. 
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Experiment: 

In  this  research,  we  design  two  cognitive  games  between  human  subject  and  machine  agent,  and 
measure  fMRI  or  EEG  signals  to  identify  human  trust  on  machine.  The  bilateral  (reciprocal) 
interaction  in  human-machine  systems.  The  human  operator  and  machine  counterpart  make  decisions 
alternatingly  for  cooperation  in  the  reciprocal  interaction  systems.  The  this  systems  had  been  studied 
for  the  fiduciary  responsibility  (“willingness  to  cooperate”)  only  with  perfect  reliability  and  ability  of 
machine  counterparts. 

We  believe  that  many  practical  applications  such  as  auto-pilot  and  anti-warfare  systems  are  closer  to 
the  unilateral  (nonreciprocal)  interaction  systems.  When  human  and  machine  partners  work  together 
as  a  team,  or  when  human  supervises  autonomous  machine,  human  trust  in  the  machine  is  mainly 
contributed  by  the  technical  ability.  (The  autonomous  machine  should  have  high  reliability  and  also  be 
designed  to  serve  the  responsibility.)  Therefore,  it  is  important  to  measure  the  human  trust  level  from 
brain  signals  based  on  the  technical  ability  of  machine  partners. 

Human  subjects  will  play  a  cooperative  game  with  a  computer  agent  (opponent)  for  maximizing 
subject  own  payoff  as  well  as  opponent’s  payoff.  We  believe  that  a  cooperation  will  be  made  based  on 
the  TRUST  to  his  opponent,  and  the  trust  will  be  generated  if  subject  begins  to  believe  his  opponent 
has  a  “goodwill”  (willingness  to  cooperate)  and  “technical  ability”  (opponent  can  make  an  optimal 
decision  for  both  players’  payoffs).  Thus,  we  will  design  a  computer  agent  (opponent  to  human 
subject)  with  varying  traits  of  goodwill  and  technical  ability.  Human  subjects  will  evaluate  their  trust 
level  of  each  computer  agent  after  completing  games  with  self-report  questionnaire  (e.g.,  “Willingness 
to  cooperate”  describes  the  opponent  with  happy  face?).  We  will  investigate  the  relationship  between 
self-reported  trust  level  and  task  performance  (total  payoffs)  as  well  as  neural  responses.  (More  details 
are  described  in  1 1 .  Outcome  evaluation  criteria  and  evaluation  methods) 

Results  and  Discussion: 

For  both  bilateral  and  unilateral  games,  we  found  brain  areas  and  time  representing  the  human  trust  on 
machine. 
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